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Amendments to the Claims : 

This listing of the claims will replace all prior versions, and listings, of 
claims in the application: 

Listing of Claims : 
1-2. (canceled) 

3. (original) The method according to claim 38, wherein the correlation is 
approximately equal to a ratio of an area of a logical AND between a figure obtained by 
moving one of the temporally adjacent first figures on the basis of a motion vector 
thereof and the other of the temporally adjacent first figures to an area of the one or the 
other of the temporally adjacent first figures. 

4-6. (canceled) 

7. (original) The apparatus according to claim 39, wherein the correlation 
of the step (b) is approximately equal to a ratio of an area of a logical AND between a 
figure obtained by moving one of the temporally adjacent first figures on the basis of a 
motion vector thereof and the other of the temporally adjacent first figures to an area of 
the one or the other of the temporally adjacent first figures. 

8-12. (canceled) 

13. (currently amended) A method of tracking moving objects in time- 
series pictures with-bv processing the pictures using a processor , each picture being 
divided into blocks, each block consisting of a plurality of pixels, wherein in a case 
where an object-identification i dont i f i cat i on code of moving object is assigned in a unit of 
block, and a motion vector of moving object is determined in a unit of block, and 
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wherein object-identification codes of a plurality of moving objects on a picture at a time 
t1 have been determined, the method , using the processor, comprising the steps of: 

(a) est i mat i ng a mot i on vector from a b l ock s i zo reg i on i n a p i cture at a 
t i mo t1 to a reg i on of i ntorost i n a p i cture at a t i mo t2 as MV, and est i mat i ng an 
i dent i f i cat i on codo of tho b l ock of i nterest as I D; 

(b) dotorm i n i ng a corre l at i on related amount i nc l ud i ng an abso l ute va l ue of 
a d i fforonco between tho est i mated mot i on vector MV of tho b l ock of i ntorost and a 
mot i on vector of at l east one, hav i ng an i dentificat i on codo equa l to I D, of b l ocks 
surround i ng tho b l ock of i ntorost i n tho p i cture at tho t i mo t2; and 

(c) dotorm i n i ng a va l uo of an ost i mat i on funct i on i nc l ud i ng tho corro l at i on - 
ro l atod amount for oach f i rst reg i on moved w i th i n a prodotorm i nod rango, and 
dotorm i n i ng tho mot i on vector MV and tho i dent i f i cat i on codo on tho bas i s of an 
approx i mate l y opt i mum va l uo of tho ost i mat i on funct i on- 
determining each object-identification code and moving vector as 

approximate values of each of the blocks on a picture at a time t2 on the basis of a first 
estimation function, 

determining a value of a second estimation function using the approximate 

values; and 

determining each object-identification code and moving vector as a 
solution of each of the blocks on the basis of an approximately-optimum sum of the first 
and second estimation functions, 
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wherein the approximately-optimum sum is obtained by changing the 
approximate values within a given range; 

wherein the first estimation function has the sum of a sub-estimation 
function for determining a moving vector by block matching between a current block on 
the picture at the time t2 and a region on the picture at the time t1 and a sub-estimation 
function for determining an object-identification code of the current block on the basis of 
a count of pixels belonging to the same object-identification code within the region, 

wherein the second estimation function includes respective absolute 
values of differences between the motion vector MV between the current block and the 
region and a motion vector of each of blocks around the current block, each of the 
blocks having the same obiect-identification code as that of the current block, and takes 
a more optimum value when the sum of the absolute values is smaller. 

14. (currently amended) The method according to claim 13, wherein the 
corro l at i on ro l atod amount of tho stop (c) the second estimation function includes is 
oxprossod by Z|MV-MV n eighbor|/L, where MV ne ighbor denotes a motion vector of a block 
having the same obiect- identification code as tho i dont i f i cat i on codo ID of the current 
block of i ntorost , within blocks surrounding the current block of i ntorost , I denotes a 
sum over the blocks having said same obiect- identification code ID, and L denotes a 
number of the blocks having said same obiect- identification code ID. 

15. (currently amended) An apparatus for tracking moving objects in 
time-series pictures, comprising: 

a storage device for storing the time-series pictures and a program; 
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and a processor coupled to the storage device, wherein the program make 
the processor read and process the time-series pictures to track the moving objects in 
the pictures, and by the processing, each picture is divided into blocks, each block 
consisting of a plurality of pixels, in a case where an object-identification i dont i f i cat i on 
code of moving object is assigned in a unit of block, and a motion vector of moving 
object is determined in a unit of block, and wherein object-identification codes of a 
plurality of moving objects on a picture at a time t1 has been determined, the program 
comprising the step of: 

(a) est i mat i ng a mot i on vector from a b l ock s i zo reg i on i n a p i cture at a 
t i me t1 to a reg i on of i nterest i n a p i cture at a timo t2 as MV, and est i mat i ng an 
i dont i f i cat i on code of the b l ock of i ntorost as I D; 

(b) dotorm i n i ng a corre l at i on re l ated amount i nc l ud i ng an absolute va l ue of 
a d i fference between the est i mated mot i on vector MV of tho b l ock of i ntorost and a 
mot i on vector of at l east one, hav i ng an idontificat i on codo equa l to I D, of b l ocks 
surround i ng tho b l ock of i ntorost i n tho p i cture at tho t i mo t2; and 

(c) dotorm i n i ng a va l ue of an estimat i on funct i on i nc l ud i ng tho corro l at i on - 
ro l atod amount for oach f i rst reg i on moved w i thin a prodotorm i nod range, and 
dotorm i n i ng tho mot i on vector MV and tho idont i f i cat i on codo on tho bas i s of an 
approx i mato l y - opt i mum va l ue of tho estimat i on funct i on- 
determining each object-identification code and moving vector as 

approximate values of each of blocks on a picture at a time t2 on the basis of a first 
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estimation function, and determining a value of a second estimation function using the 
approximate values; 

determining each object-identification code and moving vector as a 
solution of each of the blocks on the basis of an approximately-optimum sum of the first 
and second estimation functions, wherein the approximately-optimum sum is obtained 
by changing the approximate values within a given range; 

wherein the first estimation function has the sum of a sub-estimation 
function for determining a moving vector by block matching between a current block on 
the picture at the time t2 and a region on the picture at the time t1 and a sub-estimation 
function for determining an object-identification code of the current block on the basis of 
a count of pixels belonging to the same object-identification code within the region, 

wherein the second estimation function includes respective absolute 
values of differences between the motion vector MV between the current block and the 
region and a motion vector of each of blocks around the current block, each of the 
blocks having the same object-identification code as that of the current block, and takes 
a more optimum value when the sum of the absolute values is smaller. 

16. (currently amended) The method according to claim 15, wherein the 
corro l at i on ro l atod amount of tho stop (c) the second estimation function includes is 
oxprossod by I|MV-MV n eighbor|/L, where MV ne ighbor denotes a motion vector of a block 
having the same object- identification code as tho i dont i f i cat i on codo ID of the current 
block of i ntorost , within blocks surrounding the current block of i nterest , I denotes a 
sum over the blocks having said same obiect-identification i dont i f i cat i on code ID, and L 
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denotes a number of the blocks having said same object-identification i dont i f i cat i on 
code ID. 

17-20. (canceled) 

21 . (currently amended) An apparatus for tracking moving objects in 
time-series pictures, comprising: 

a storage device for storing the time-series pictures and a program; 

and a processor coupled to the storage device, wherein the program make 
the processor read and process the time-series pictures to track the moving objects in 
the pictures, and by the processing, each picture is divided into blocks, each block 
consisting of a plurality of pixels, the program comprising the step of: 

(b1 ) determining motion vectors of respective blocks in a picture at a time 
t2 through the use of block matching between a picture at a time t1 and the picture at 
the time t2, without discriminating between the background image and moving objects; 

(b2) determining motion vectors of blocks, which are not determined at the 
step (b1), by estimating the motion vectors through the use of the method according to 
any one of c l a i ms 9, claims 1 3 or 1 4; and 

(b3) assigning the same identification code to adjacent blocks if an 
absolute value of a difference between motion vectors of the adjacent blocks is less 
than a predetermined value. 

22-23. (canceled) 

24. (currently amended) The method according to 42, wherein each of 
the first and second regions of i ntorost of the step (a) corresponds to one block. 
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25. (currently amended) The method according to 42, wherein the object 
map of the step (a) is a new object map, and at the step (b), the two regions reg i on of 
i ntorost i s are moved in the negative direction of the their motion voctor vectors, 
respectively . 

26. (original) The method according to 42, wherein the number of the 
plurality of object maps is kept constant by updating an oldest object map with a newest 
object map. 

27. (canceled) 

28. (currently amended) The method according to c l a i m 27 claim 42 , 
wherein, the first region at the time t1 is a single cluster including adjacent blocks and if 
a plurality of peaks are present in a histogram of absolute values of motion vectors of 
the blocks for i nc l ud i ng ad i acont b l ocks hav i ng mot i on vectors , an interval between the 
times t1 and t2 is determined on the basis of a speed difference between the peaks. 

29. (currently amended) The method according to c l a i m 27 claim 42 , 
wherein each time the interval between the times t1 and t2 is increased, it is determined 
whether or not the absolute value of the difference between the rospoct i vo first and 
second fast-forward motion vectors of tho two adjacent reg i ons of i ntorost on tho object 
map of tho t i me t2 is more than the predetermined value, and wherein if the interval is 
less than a predetermined maximum value and if the absolute difference is more than 
the predetermined value, then the two adjacent first and second regions of i ntorost are 
recognized as different moving objects to each other . 

30-31. (canceled) 
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32. (currently amended) The method according te-43 to claim 42 , 
wherein each of the first and second regions of i ntorost of the step (a) corresponds to 
one block. 

33. (currently amended) The method according te-43 to claim 42 , 
wherein the object map of the step (a) is a new object map, and at the step (b), the two 
roq i on reqions of i ntorost i s are moved in the negative direction of the their motion 
voctor vectors, respectively . 

34. (currently amended) The method according te-43 to claim 42 , 
wherein the program further comprises the step of: 

keeping the number of the plurality of object maps constant by updating 
an oldest object map with a newest object map. 

35. (canceled) 

36. (currently amended) The apparatus according to c l a i m 35 claim 43, 
wherein the first region at the time t1 is a single cluster including adjacent blocks and , 
wherein the program further comprises the step of: 

if a plurality of peaks are present in a histogram of absolute values of 
motion vectors of the blocks for a s i ng l e cluster inc l ud i ng adjacent b l ocks hav i ng mot i on 
vectors , determining an interval between the times t1 and t2 on the basis of a speed 
difference between the peaks. 

37. (currently amended) The apparatus according to c l a i m 35 claim 43 , 
wherein the program further comprises the step of: 
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each time the interval between the times t1 and t2 is increased, 
determining whether or not the absolute value of the difference between the rospoct i vo 
first and second fast-forward motion vectors of tho two adjacent reg i ons of i ntorost on 
tho object map of tho t i mo t2 is more than the predetermined value; and 

if the interval is less than a predetermined maximum value and if the 
absolute difference is more than the predetermined value, recognizing the two adjacent 
first and second regions of i ntorost as different moving objects to each other . 

38. (currently amended) A method of tracking moving objects in time- 
series pictures with-bv processing the pictures using a processor , each picture being 
divided into blocks, each block consisting of a plurality of pixels, wherein in a case 
where an identification code of moving object is assigned in a unit of block, and a 
motion vector of moving object is determined in a unit of block, the method being 
implemented using the processor, comprising the steps of: 

(a) for each of N (N^2) consecutive pictures within the time-series 
pictures, assigning the same identification code to adjacent blocks if an absolute value 
of a difference between motion vectors of the adjacent blocks is less than a 
predetermined value, thereby allowing different identification codes to be assigned to 
different moving objects overlapping in a picture; 

(b) judging whether or not: 

a first object consisting of a group of blocks assigned a first identification 
code and a second object consisting of a group of blocks assigned a second 
identification code are in contact with each other in each of the N consecutive pictures; 
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and a correlation between the first objects in every temporally adjacent 
pictures in the N consecutive pictures is more than a predetermined value; 

(c) tracking the first and second objects backward in time after the 
judgment of the step (b) is positive. 

39. (original) An apparatus for tracking moving objects in time-series 
pictures, comprising: 

a storage device for storing the time-series pictures and a program; 

and a processor coupled to the storage device, wherein the program make 
the processor read and process the time-series pictures to track the moving objects in 
the pictures, and by the processing, each picture is divided into blocks, each block 
consisting of a plurality of pixels, an identification code of moving object is assigned in a 
unit of block, and a motion vector of moving object is determined in a unit of block, the 
program comprising the step of: 

(a) for each of N (N^2) consecutive pictures within the time-series 
pictures, assigning the same identification code to adjacent blocks if an absolute value 
of a difference between motion vectors of the adjacent blocks is less than a 
predetermined value, thereby allowing different identification codes to be assigned to 
different moving objects overlapping in a picture; 

(b) judging whether or not: 

a first object consisting of a group of blocks assigned a first identification 
code and a second object consisting of a group of blocks assigned a second 
identification code are in contact with each other in each of the N consecutive pictures; 
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and a correlation between the first objects in every temporally adjacent 
pictures in the N consecutive pictures is more than a predetermined value; and 

(c) tracking the first and second objects backward in time after the 
judgment of the step (b) is positive. 

40. (original) A method according to any one of claims 13 or 14, wherein 
a background image is regarded as a moving object. 

41 . (currently amended) A method of tracking moving objects in time- 
series pictures with processing the pictures by a processor , the method , using the 
processor, comprising the steps of: 

(a) dividing each picture into blocks, each block consisting of a plurality of 

pixels; and 

(b) with regarding a background image as a moving object, assigning an 
identification code of moving object in a unit of block and determining a motion vector of 
the moving object in a unit of block; 

wherein the step (b) comprises the steps of: 

(b1) determining motion vectors of respective blocks in a picture at a time 
t2 through the use of block matching between a picture at a time t1 and the picture at 
the time t2, without discriminating between the background image and moving objects; 

(b2) determining motion vectors of blocks, which are not determined at the 
step (b1), by estimating the motion vectors through the use of the method according to 
any one of c l a i ms 9, claims 1 3 or 1 4; and 
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(b3) assigning the same identification code to adjacent blocks if an 
absolute value of a difference between motion vectors of the adjacent blocks is less 
than a predetermined value. 

42. (currently amended) A method of tracking a moving object in time- 
series pictures with processing the pictures by a processor , each picture being divided 
into blocks, each block consisting of a plurality of pixels, wherein a plurality of object 
maps of different times have been stored, each object map having motion vectors of the 
moving object in a unit of block, the method , using the processor, comprising the steps 
of: 

(a) determining a respective motion vectors of a first and second regions 
adjacent to each other of i ntorost for on one at time t1 of the plurality of object maps; 
and 

(b) determining a respective motion vectors of a two regions , to which the 
first and second roq i on reqions of i ntorost is are moved with using the determined 
motion vector s, respectively, in positive or negative direction thereof, on the basis of an 
object map at a time corresponding to completion of the movement of the roq i on reqions , 

wherein tho moved reg i on i s sot as a reg i on of i ntorost on tho object map 
of tho t i mo correspond i ng to tho comp l etion of tho movomont of tho reg i on, and the step 
(b) is repeated a plurality of times to track until a time t2 the two roq i on reqions 
corresponding to the first and second regions, of i ntorost, 

wherein at the step (a) or the step (b), for each current region of the two 
regions, a weighted motion vector average is determined as a motion vector of the 



- 13- 



Appln. No. 10/540,217 

Amdt. dated April 22, 2010 

Reply to Office action of November 25, 2009 



region of i nterest with using motion vectors of blocks overlapping with the current region 
of i ntorost , where weights given to the respective motion vectors correspond to the 
number of pixels of respective portions overlapping between the respective blocks and 
the current region of i nterest. 

the method, using the processor, further comprising the steps of: 

obtaining a motion vector from the first region at the time t1 to the 
corresponding region at the time t2 as a first fast-forward motion vector by accumulating 
corresponding motion vectors between the times t1 and t2. obtaining a motion vector 
from the second region at the time t1 to the corresponding region at the time t2 as a 
second fast-forward motion vector by accumulating corresponding motion vectors 
between the times t1 and t2: and 

recognizing the first and second regions at the time t1 as different moving 
objects if an absolute value of the difference between the first and second fast-forward 
motion vectors is more than a predetermined value. 

43. (currently amended) An apparatus for tracking moving objects in 
time-series pictures, comprising: 

a storage device for storing the time-series pictures and a program; 

and a processor coupled to the storage device, wherein the program make 
the processor read and process the time-series pictures to track the moving objects in 
the pictures, and by the processing, each picture is divided into blocks, each block 
consisting of a plurality of pixels, a plurality of object maps of different times have been 
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stored, each object map having motion vectors of the moving object in a unit of block, 
the program comprising the step of: 

(a) dotorm i n i ng a determining respective motion voctor vectors ef-a of first 
and second feeje ffl-eoions adjacent to each other of i ntorost for on one at time t1 of the 
plurality of object maps; and 

(b) dotorm i n i ng a determining respective motion voctor vectors ef-a of two 
rog i on regions , to which the first and second rog i on regions of i ntorost i s are moved with 
using the determined motion voctor vectors, respectively, in positive or negative direction 
thereof, on the basis of an object map at a time corresponding to completion of the 
movement of the rog i on regions , 

wherein tho moved reg i on i s sot as a reg i on of i ntorost on tho object map 
of tho t i me correspond i ng to tho comp l et i on of tho movement of tho reg i on, and the step 
(b) is repeated a plurality of times to track until a time t2 the two rog i on regions 
corresponding to the first and second regions, of i ntorost, 

wherein at the step (a) or the step (b), for each current region of the two 
regions, a weighted motion vector average is determined as a motion vector of the 
region of i ntorost with using motion vectors of blocks overlapping with the current region 
of i ntorost , where weights given to the respective motion vectors correspond to the 
number of pixels of respective portions overlapping between the respective blocks and 
the current region of i nterest. 

the program further comprising the steps of: 



- 15- 



Appln. No. 10/540,217 

Amdt. dated April 22, 2010 

Reply to Office action of November 25, 2009 

obtaining a motion vector from the first region at the time t1 to the 
corresponding region at the time t2 as a first fast-forward motion vector by accumulating 
corresponding motion vectors between the times t1 and t2. obtaining a motion vector 
from the second region at the time t1 to the corresponding region at the time t2 as a 
second fast-forward motion vector by accumulating corresponding motion vectors 
between the times t1 and t2: and 

recognizing the first and second regions at the time t1 as different moving 
objects if an absolute value of the difference between the first and second fast-forward 
motion vectors is more than a predetermined value. 
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